Topological-Fermi-Liquid to Quantum- Hall- Liquid Transitions: p-Band and d-Band 

Fermions in a Magnetic Field 
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We find that in a multi-orbital system with intraorbital and interorbital hopping integrals, the 
Hall conductance exhibits various topological quantum phase transitions (QPTs) induced by on-site 
orbital polarization: integer quantum Hall (1QH) plateau transitions, and topological Fermi liquid 
to IQH transitions. Such topological QPTs are demonstrated in two systems: a p-band spinless 
fermionic system realizable with ultracold atoms in optical lattice, and a d-band spinful fermionic 
system closely related to giant orbital Hall effects in transition metals and their compounds. 

PACS numbers: 73.43.Nq, 73.43.Cd, 03.75.Ss, 72.80.Ga 



Introduction. — Orbital is an additional degree of free- 
dom independent of charge and spin, and is characterized 
by orbital degeneracy and spatial anisotropy. Recently, 
it is proposed that novel p-orbital physics exist in optical 
lattices, and earlier attention has been paid on bosons in 
the first excited p-orbital bands [l[ . Rapid experimental 
advances in loading and controlling alkali atoms on the 
excited bands makes the p-orbital physics truly fascinat- 
ing [2], y, |J] , and especially a metastable p-orbital bosonic 
system has been realized [3]. Correlated fermions in the 
p-orbital bands possess more arresting behaviors, includ- 
ing Wigner crystallization, orbital ordering and frustra- 
tion 0, Even for non- interacting p-band spinless 
fermions, non-trivial topological band structures arises 
from lifting the orbital degeneracy, and Haldane's quan- 
tum Hall model without Landau levels [8[ can be real- 
ized @. 

In parallel, for transition metal oxides, the relevant 
active orbitals are the partially filled five d-orbitals. Re- 
cently, giant spin Hall and orbital Hall effects have been 
found in transition metals and their compounds 13, 11 



12J, and many theoretical studies are based on realistic 
multiband Ad or bd models (l3i 14, 15 1. A possible in- 
trinsic origin of these giant Hall effects is the "orbital 
Aharonov-Bohm phase" which is induced by the on-site 
spin-orbital coupling (SOC) and the phase of interorbital 
hopping integrals characteristic of d-orbital systems, and 
therefore the conduction electrons are subject to an ef- 
fective spin-dependent magnetic field LJ, [l4| . 

Given the intensive current interest in possible novel 
p-orbital and d-orbital physics which has not appeared 
in single-orbital systems, we are motivated to study 
magneto-transport properties of multi-orbital systems 
with intraorbital and interorbital hopping integrals mod- 
ulated by an external magnetic flux, and find that the 
Hall conductance (HC) may exhibit various topological 
quantum phase transitions (QPTs) induced by on-site or- 
bital polarization: integer quantum Hall (IQH) plateau 
transitions, and topological Fermi liquid (TFL) to IQH 



transitions. An IQH effect, characterized by a nonzero 
Chern integer (ljj |. only occurs when the Fermi level lies 
in an energy gap, and is a Fermi sea property. While 
the non-quantized part of the HC of a TFL is charac- 
terized by a Berry phase accumulated by adiabatic mo- 
tion of quasiparticles on the Fermi surface (FS), and is 
thus purely a Fermi liquid property [l7| . Such topolog- 
ical QPTs are demonstrated in two systems: a p-band 
spinless fermionic system which is proposed to be real- 
ized with ultracold atoms in optical lattice and a 
c?-band spinful fermionic system which is closely related 
to giant orbital Hall effect in transition metals and their 
compounds 3, 3j- 

Formulation. — The first model is a p-band system of 
p x and p y orbitals in a 2D square lattice filled with spin- 
less fermions coupled with an artificial uniform magnetic 

flux [ESSSEi: 

Hp = J2 E <w] 

X [p^rP^r+ev exp (i^ r , r +ej + H.C.] 

+A ^ {ivl,rPy,r ~ ipl, r Px.r) , (1) 



where p^ r is a fermion creation operator of /i = x, y 
p-orbital at site r. ty and t± are the nearest neighbor 
(NN) hopping integrals in the longitudinal and trans- 
verse directions, respectively, to each p-orbital orienta- 
tion. fii,t_L > 0, and t± is conventionally one order of 
magnitude smaller than t\\. In the following, t|| will be 
taken as the unit of energy. A finite A induces the ro- 
tation of each site around its own center, thus gives rise 
to orbital polarization by lifting the degeneracy between 
p x ± ip y orbitals [1, 

The second model is a <i-band system of d xz .a and d yZilT 
orbitals (the notation is simplified as d X z,a = d xa and 
dyz,a = dyu ) in a 2D square lattice filled with spinful 
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fermions coupled with a uniform mag netic flux [H[i3: 

H d = ~*|| E [ d iUr ( V,r+e )1 exP (#r,r+ej + H.C.] 
r,cr,/x 

+ *'E [4o-,r<W , ±e a> ±e, ( exp (i^rie^ie,,) + H.C.] 
yo^rie^ey GXp (i(/) r ,r±e^ej + H.C.J 

r.a 

+ A E ( id U,r d yl>* ~ id U,r d vr,r + H.C.) , (2) 
r 

where r creates a fermion of \i = xz,yz d-orbital and 
spin a =f, | at site r. tii is the NN intraorbital hopping 
integral in the longitudinal direction, and ±t' is the next 
NN interorbital hopping integrals. > 0, and t' is 

one order of magnitude smaller than tu. And t\\ will also 
be taken as the energy unit. Here A is the atomic SOC 
strength 03] > and it also causes orbital polarization, 
but with a spin dependence. 

We consider 1/N magnetic flux quantum per plaquette 
(N is an integer), i.e. </> = J2a fai = ^Ba 2 /(f> = 2n/N, 
with a the lattice constant and (f> = hc/e the flux quan- 
tum. The Landau gauge A = (0, — Bx,0) and the peri- 
odical boundary conditions (PBCs) are adopted, and the 
magnetic unit cell has the size N X 1. After the numerical 
diagonalization of the Hamiltonian, the zero-temperature 
HC is calculated through the Kubo formula (ljj 



ie 2 h 



me) = ^ E E 

e nk <E e mk >E 
(nk\v x \mk){mk\v y |nk) — (nk|fj / |mk}(mk|u x |nk} i 



(3) 



where A = L x I is the area of this 2D system, i5 is 
the Fermi energy, £ n k is the corresponding eigenvalue 
of the eigenstate nk) of nth Landau subband, and the 
summation over wave vector k is restricted to the mag- 
netic Brillouin zone (MBZ): -ir/N < k x a < n/N and 
— 7r < k y a < n. The velocity operator is defined as 
v = (i/h) [H, R] , with R as the position operator of 
fermions. When E falling in energy gaps, we can rewrite 



cr H as an(E) = Ef„<B cr H 



(n) 



' 2 / h Y.s n <E C n, where 
er^ and C n are the HC and the Chern number [l6| of 
the nth completely filled subband, respectively. 

Now let us introduce the Berry connection A„(k) = 
i(nk|Vk|nk), and the Berry curvature fi„(k) = 
Vk x A„(k). With these definitions, the quan- 
tized HC of a completely filled nth subband can be 
written as (h/e 2 )a^ = (1/2tt) f J MBZ W n (k)d 2 k = 

(V27r) f MBZ A„(k) • dk = r^ z /27r, where is the 

Berry phase of the cyclic evolution of the nth eigenstate 
|nk) along the MBZ boundary [l6j]. While for a partially 
filled nth subband, the non-qunatized part of the HC can 
also be written as (h/e 2 )a^ = (1/2-71") ^ pg A„(k) • dk = 
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FIG. 1: (color online), (a) Hall conductance versus A (unit: 
in) of p-band spinless fermions at v — 1/8 with N = 4 and 
various tj_'s. (b)-(i) The DOS for some t±'s and A's in (a). 



T$/2ir, where now is the Berry phase of the cyclic 
evolution of |nk) along the FS [13] • It is also instructive 
to introduce the sum of Berry curvatures over the occu- 
pied subbands (for each k): fi z (k) — J2s„<e ^n(k)- 

p-band spinless fermions. (a) Hall conductances. — An 
overall picture of the HC cth calculated by Eq. is 
shown in Fig.[T]for p-band spinless fermions [Eq. (JTJ] with 
N = 4 (i.e., the flux strength <p = \ x 2tt), 2048 x 2048 
lattice sites, fermion filling v = 1/8, and various £j_'s. 

In the case of A = Q, the lowest two subbands (each 
contributes | to v) are not separated; they give rise to 
a total Chern number +2. With A increasing from to 
2.0 one sees a systematic evolution of <th versus A; for 
smaller fj_'s, there is a quantum critical point (QCP) A c i 
at which the lowest two subbands begin to separate; for 
larger t±'s, besides the first QCP A c i, there is another 
QCP A C 2 at which cth exhibit a quantized jump. 

At smaller t±'s (t± = 0.00, . . . , 0.18), for A > A ci (e.g. 
A c i — 0.64 for t± = 0.10), the lowest two subbands are 
well separated since A lifts the p-orbital degeneracy and 
induces a finite energy gap; the lowest subband is occu- 
pied by p x + ip y fermions while the second lowest one by 
Px — iPy fermions, each subband carrying a Chern number 
+1, and ct h = +le 2 /h (i.e. C\ = +1) at v = 1/8. 

At larger ij_'s (t± = 0.20,0.25,0.30), for A > X cl (e.g. 
A c i — 0.97 for t± = 0.30), the lowest two subbands are 
also well separated; however, the lowest subband occu- 
pied by p x + ip y fermions now gives a Chern number 
C\ = —3. When A increases further to another QCP A C 2 
(e.g. A C 2 — 1-59 for t±_ = 0.30), cth exhibit a quantized 
jump from —3e 2 /h to +le 2 /h &tv= 1/8 (i.e. C\ changes 
from —3 to +1). 

The above behaviors of HCs have also been verified 
by further numerical calculations of the cases with N — 
6 — 16, various £j_'s, and various u's (TablelJ). 

(b) Berry curvatures. — In order to reveal the non- 
trivial topological properties, we plot in Fig. [2] the 
Berry curvatures £l z {k), in the reduced MBZ (RMBZ) 
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TABLE I: Topological QPTs of p-band spinless fermions. 



(N,v,tx) Xd A c2 


quantized jump of <th at A C 2 


(6, 1/12, 0.25) 0.70 1.16 


-5e 2 /h — 


-> +le 2 /h 


(8, 1/16, 0.20) 0.50 0.89 


-7e 2 /h — 


-> +le 2 /h 


^o, of 10, U.zoJ U.41 U.oy 


-5e 2 /h — 


-> +3e 2 //i 


(12, 1/24,0.20) 0.42 0.92 


-lle 2 /h - 


-> +le 2 /ft 


(12,3/24,0.20) 0.29 0.45 


-9e 2 /h - 


-» +3e 2 //i 


(16, 1/32,0.10) 0.24 0.44 


-15e 2 /h - 


-> +le 2 //i 


(16,3/32,0.20) 0.26 0.53 


-13e 2 /h - 


-> +3e 2 /ft 


(16,5/32,0.20) 0.20 0.26 


-lle 2 /h - 


-f +5e 2 //i 




(h) t_=0.3, M-59 
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FIG. 2: (color online). Intensity plots of Berry curvatures 
S~2 z (k) in the RMBZ of p-band fermions at v = 1/8 with 
N = 4, various tx's and A's. 



(—n/N < k x a,k y a < ir/N) for some typical parameters 
corresponding to Fig. [TJ 

We first look into the case of t± — 0.1 which has only 
one A c (see Fig. [TJ. For A < A ci ~ 0.64, e.g. A = 0.2 
[Fig. Ufa)], f2 z (k) displays the FS topology of two sub- 
bands: a hole FS of the lowest subband near four corners 
of the RMBZ, and an fermion FS of the second lowest 
subband near the center of the RMBZ. There are four 
small negative-l~i z (k) regions near the hole FS. When A 
increases, the two subbands starts to separate and two 
FSs shrinks gradually [Fig. [2(b)]. For A > A c i, e.g. 
A = 0.8 [Fig. [2(c)], the two subbands separates com- 
pletely, both FSs vanishes, and l~i z (k) displays four max- 
ima at the four RMBZ corners (these maxima contribute 
to the quantized C\ = +1). 

We then analyze the case of t± = 0.3 which has two 



Ac's (see Fig. [TJ. For a small A = 0.2 [Fig. [2(d)], 
f2 z (k) also displays the FS topology of two subbands. 
H z (k) displays four negative regions between the hole 
and particle FSs. When A increases, e.g. A = 0.5, 0.8 
[Figs. [5(e) and (f)], negative-ri z (k) regions also increase, 
change their topology, and enclose the four RMBZ cor- 
ners, with the two FSs shrinking. When A increases and 
passes Ad = 0.97, e.g. A = 1.2 [Fig. [2(g)], the two sub- 
bands separates completely, and both FSs vanishes, and 
O z (k) displays four negative-f2 z (k) minima at the four 
RMBZ corners (these minima contribute to the quantized 
Ci = -3). Near A c2 ^ 1.59 [Fig. [2(h)], four negative- 
O z (k) minima at the RMBZ corners begin to vanish. 
When A increases further and passes A C 2, e.g. A = 2.0 
[Fig. H(i)], the two subbands separates completely and 
four negative-l~2 z (k) minima vanishes, and are replaced 
by positive-O z (k) maxima at the RMBZ corners (these 
maxima contribute to the quantized C\ — +1 again). 

(c) Edge states. — An alternative way to reveal different 
topological characters and QPTs is to calculate the edge 
states [19(. Now as an illustration, we take a cylinder of 
square lattice of the size 64 x oo with N = 4 (i.e., the 
flux strength <f> = i x 27r), t± — 0.30 and various A's, and 
apply open boundary condition (OBC) in x direction and 
PBC in y direction. 

Chern numbers of the bulk subbands are intimately re- 
lated to the winding numbers of the corresponding edge 
states [ijj]. We here concentrate on the edge states be- 
tween the lowest two subbands shown in Fig. [3l For 
< A < Ad ~ 0.97 (see the t± = 0.30 curve in 
Fig. [TJ, e.g. A = 0.50 [Fig. [3(a)], there is one edge state 
winding between the lowest two subbands, however, the 
Chern number of the lowest subband C\ is not well de- 
fined since the energy overlap of the two subbands. For 
Ad < A < A c2 ^ 1-59, e.g. A = 1.20 [Fig. [3(b)], there is 
one edge state winding three times from the lowest sub- 
band to the upper one then back to the lowest one which 
corresponds to C\ = —3. While A > A C 2, e.g. A = 2.00 
[Fig. [3(d)], there is another edge state winding only once 
from the upper subband to the lowest one then back to 
the upper one which corresponds to C\ = +1. 

The continuum spectra of this cylinder also give fur- 
ther descriptions about the correspondence between the 
quantized jumps of the HCs and the topological evolu- 
tions of bulk spectra [i, 2(], 21 1. When approaching A C 2, 
four pairs of Dirac cones begin to form between the low- 
est two subbands, and each pair of Dirac cones touch 
at one Dirac point when A C 2 — 1-59 [Fig. [3(c)]. Mean- 
while, a topological QPT happens at A C 2, and a Chern 
number +4 is transferred from the upper subband to the 
lowest one, through abrupt changes of Berry curvatures 
near Dirac points [Fig. [2(h)]. On contrary, at the first 
QCP A c i — 0.97, there is no Dirac point, and thus no 
quantized jumps of the HC. 

d-band spinful fermions. — Some typical examples of 
the HC <7h calculated by Eq. ([3J are shown in Fig. Q] 
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(a) \=0.50 



(b) X=1 .20 




FIG. 3: (color online). E(k y ) of lowest four subbands and 
edge states [shown as thick (red) lines] of p-band fermions in 
a 64 x oo cylinder with t± = 0.30 and various A's. 
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d-band spinful fermions at various N's, f's and t 



for d-band spinful fermions [Eq. ©J with various TV's, 
f's and i"s. We note that TFL-to-IQH transitions occur 
frequently when tuning A to critical values A c 's. Since 
now we have two spin components, cth may change either 
2Ne 2 /h [e.g. the t' = 0.3 case in Fig.g^a)] or Ne 2 /h [e.g. 
the t' = 0.4 case in Fig. HJc)], after passing a TFL region 



or a quantized jump. 

Summary and discussion. — We present that in a multi- 
orbital system with intraorbital and interorbital hopping 
integrals, the HC may exhibit various topological QPTs 
induced by on-site orbital polarization: IQH plateau 
transitions, and TFL to IQH transitions. Berry curva- 
tures and edge states give further insights to reveal dif- 
ferent topological characters and QPTs. Such topolog- 
ical QPTs are demonstrated in both a p-band spinlcss 
fcrmionic system in optical lattice, and a d-band spinful 
fermionic system related to giant orbital Hall effects in 
transition metals and their compounds. In optical lat- 
tices, artificial magnetic fields can be created by laser as- 
sisted tunneling between internal atomic states, or time- 
varying quadrupole potential [2^ |. 
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